Stiff neural ordinary differential equations
نویسندگان
چکیده
Neural Ordinary Differential Equations (ODEs) are a promising approach to learn dynamical models from time-series data in science and engineering applications. This work aims at learning neural ODEs for stiff systems, which usually raised chemical kinetic modeling biological systems. We first show the challenges of classical ODE systems Robertson’s problem propose techniques mitigate associated with scale separations then present successful demonstrations an air pollution problem. The that usage deep networks rectified activations, proper scaling network outputs as well loss functions, stabilized gradient calculations key enabling ODEs. success opens up possibilities using applications widely varying time-scales, such dynamics energy conversion, environmental engineering, life sciences.
منابع مشابه
APPLICATION NEURAL NETWORK TO SOLVE ORDINARY DIFFERENTIAL EQUATIONS
In this paper, we introduce a hybrid approach based on neural network and optimization teqnique to solve ordinary differential equation. In proposed model we use heyperbolic secont transformation function in hiden layer of neural network part and bfgs teqnique in optimization part. In comparison with existing similar neural networks proposed model provides solutions with high accuracy. Numerica...
متن کاملAdditive Runge-Kutta Methods for Stiff Ordinary Differential Equations
Certain pairs of Runge-Kutta methods may be used additively to solve a system of n differential equations x' = J(t)x + g(t, x). Pairs of methods, of order p < 4, where one method is semiexplicit and /(-stable and the other method is explicit, are obtained. These methods require the LU factorization of one n X n matrix, and p evaluations of g, in each step. It is shown that such methods have a s...
متن کاملHeterogeneous multiscale methods for stiff ordinary differential equations
The heterogeneous multiscale methods (HMM) is a general framework for the numerical approximation of multiscale problems. It is here developed for ordinary differential equations containing different time scales. Stability and convergence results for the proposed HMM methods are presented together with numerical tests. The analysis covers some existing methods and the new algorithms that are ba...
متن کاملA Parallel Algorithm for Stiff Ordinary Differential Equations
The problem associated with the stiff ordinary differential equation (ODE) systems in parallel processing is that the calculus can not be started simultaneously on many processors with an explicit formula. The proposed algorithm is constructed for a special classes of stiff ODE, those of the form y'(t)=A(t)y(t)+g(t). It has a high efficiency in the implementation on a distributed memory multipr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Chaos
سال: 2021
ISSN: ['1527-2443', '1089-7682', '1054-1500']
DOI: https://doi.org/10.1063/5.0060697